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ABSTRACT 


We  derive  the  asymptotic  distributions  of  the  sample  mean. 


autocovariances  and  autocorrelations  for  a  time  series  whose  autocovariance 
function  has  the  power-law  decay  Y^~Xka,  A>0,  0  <  a  <  1,  as 

k  -*■  The  results  differ  in  many  respects  from  the  corresponding  results  for 


short-memory  processes,  whose  autocovariance  functions  are  absolutely 
summable.  For  long-memory  processes  the  variances  of  the  sample  mean,  and  of 
the  sample  autocovariances  and  autocorrelations  for  0  <  a  <  V2  ,  are  not  of 
order  n-1  asymptotically.  When  0  <  a  <  V2  the  asymptotic  distribution  of 


the  sample  autocovariances  and  autocorrelations  is  not  Normal. 
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SIGNIFICANCE  AND  EXPLANATION 


Persistence,  or  long  memory,  is  the  presence  in  a  time  series  of 
significant  dependence  between  observations  a  long  time  span  apart.  Correct 
identification  of  long  memory  in  an  observed  time  series  can  greatly  improve 
the  accuracy  of  long-range  forecasts  of  the  series,  and  can  give  a  better 
understanding  of  the  physical  processes  which  generate  the  observed  series. 
The  long-memory  phenomenon  has  been  observed  by  researchers  in  a  number  of 
areas  of  application  including  economics,  geophysics,  hydrology  and 
meterology .  '\ 

Identification  of  long  memory  in  an  observed  time  series  y1 , . . . ,yn  is 
often  based  on  the  failure  of  the  sample  autocorrelations 

n-k 

rk  *  ck/c0 ,  ck  =  n-1  )  (yt  -  y) (yt+k  “  k  =  0,1,2,.. .,n  -  1  , 

t=1 


where  y  =  (y1  +  ...  +  yn)/n  is  the  sample  mean,  to  die  away  rapidly  to  zero 
as  k  increases.  Because  rk  is  a  random  quantity  its  probability 
distribution  must  be  known  before  accurate  inferences  may  be  drawn  concerning 

it.  This  report  derives  the  distributions  of  the  sample  autocorrelations  and 

C 

related  quantities  when  the  sample  size  /n  is  large,  thereby  facilitating  the 


ASYMPTOTIC  DISTRIBUTIONS  OF  THE  SAMPLE  MEAN,  AUTOCOVARIANCES 
AND  AUTOCORRELATIONS  OF  LONG-MEMORY  TIME  SEPIES 

J.  R.  M.  Hosking* 

1.  INTRODUCTION 

Let  {yt  :  t  e  z}  be  a  second-order  stationary  time  series  with  mean  Eyt  »  u  and 

autocovariance  function  Yk  =  E{(yfc  -  wKyt+)c  ”  P)}«  We  say  that  {yfc}  has  short  memory 

or  long  memory  according  as  to  whether  £  |yv|  is  convergent  or  divergent.  Most  of  the 

k“-“> 

theory  and  practice  of  the  analysis  of  stationary  time  series  is  concerned  with  short- 
memory  series,  but  the  use  of  long-memory  models  has  been  considered  by  a  number  of 
authors,  for  example  Mandelbrot  and  Wallis  {1969),  Granger  (1980),  Granger  and  Joyeux 
(1980),  Hosking  (1981,  1984),  Jonas  (1981),  Janacek  (1982),  Geweke  and  Porter-Hudak  (1983) 
and  Li  and  McLeod  (1984).  The  models  considered  by  these  authors  mostly  have 
autocovariance  functions  which  satisfy 

Yk  ~  Ak-a,  A>0,  0  <  a  <  1,  as  k  -*  *»  .  (1) 

In  this  report  we  consider  the  large-sample  properties  -  mean,  variance  and  asymptotic 
distribution  -  of  the  sample  mean,  autocovariances  and  autocorrelations  of  long-memory  time 
series.  For  a  time  series  with  an  autocovariance  function  of  the  form  (1)  and  a  Normal 
marginal  distribution,  our  results  are  complete  and  are  summarized  in  Table  1. 

Most  of  the  results  in  Table  1  -  perhaps  all  of  them  -  are  valid  under  wider 
conditions  than  Normality  of  the  time  series.  In  our  proofs  we  shall  typically  assume  that 
(yt)  has  the  representation 

od 

Yt  *  »  +  l  Vt-j  <2) 

j-0  J  ] 

where 

~  v"8,  v  >  o,  V2  <  B  <  1,  as  j  -  -  (3) 
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Range  of  a 


0  <  a  <  1 


Order  of  magnitude  of: 
bias  variance 


autocovariances  I  0  <  a  <  V2 


-  1 

and  a  =  72 

autocorrelations  V2  <  a  <  1 


Asymptotic 
Di stribution 


"modified  Rosenblatt":  cumulants 
defined  by  (13)— (16)  below 


-a  -1 , 

n  n  log  n 


and  {a^  :  t  e  z}  is  a  white-noise  process  consisting  of  independent  and  identically 
distributed  random  variables  whose  distribution  we  shall  require  to  satisfy  any  of  the 


following  conditions: 


Ea2  =  o2  < 


4  4 

Ea^  -  a  (3  +  ic )  < 


Eafc  <  °°  for  all  positive  integers  m  ; 


at  ~  N(0,o  )  . 


Some  of  our  assumptions  are  unnecessarily  restrictive  but  are  imposed  for  convenience  of 
presentation;  some  relaxations  of  them  are  considered  in  Section  7.  When  (2)  and  (4a) 
hold,  (1)  is  a  consequence  of  (3),  as  we  now  demonstrate. 


Suppose  that  the  time  series  {yfc}  satisfies  (2),  (3)  and  (4a).  Then  the 

autocovariance  function  Y  of  (y  }  satisfies  (1),  with  a  =  26  -  1  and 

k  t 

x  =  o2v2r(26-i>r(i-e>/r(6). 

Proof .  let  V  .  =  vT( j+1-6)/r( j+1 ) ,  j  =  0,1,2,...  .  Then  {T  }  is  a  bounded  positive 
decreasing  sequence  and  ¥  ~  vj  —  as  j  ♦  «>.  Thus 

(i)  there  exists  C  >  0  s.t.  I'l'j!  <  C¥..,  j  =  0,1,2,...; 

(ii)  V  €  >  0  there  exists  J  s.t.  j  >  J  *=>  (1  -  e)¥.  <  1(1 .  <  ( 1  +  e  )¥  .  . 


Now 


From  (2)  and  (4a)  we  have  Y.  =  o  \  .  . 

*  j=0  3  3 


-  2  y  2  2  ro-eirtk-M-B)  T  i  ni+i-6)  r< j+k+i-B)  r (k-n ) 

k  _  a  ,fn  j  j+k  "  rtk+i)  £0  r ( j+ 1 >  r < i-6 )  r ( k+ 1 -b )  r<j+k+i> 


j=0 


=  o2v2  F(1-e,  k+1-0;  k+1,  1! 

r(k  +1 ) 


2  2  r(2g-i ) r ( i-g )  rot+i-g) 
-  0  v  r < s >  rtk+6) 


~  0V  r<«-;»r(i-8)  k2S-i  aa  k  .  .  , 
r  ( 6 ) 


here  F(a,8;T,x)  is  the  hypergeometric  function.  Thus  for  all  e  >  0  we  have 

J-1  J-1 


k2B-1(yk  -  rk,|  <  oVp-’||^  *  I  lo  V^l  ♦  1.^  Vj+k  -  jIj  »j*j+kl 


2,  28-1 


<  o2k2e-1J(C2  ♦  1)TQTk  +  a2k28-1(2e  +  e2)  \  1'j'fj+k  • 

j-j 


This  expression  can  be  bounded  by  a  constant  multiple  of  e  for  k  sufficiently  large. 


9  ft— 1  6  —  1 

since  the  first  term  is  0(k^  *1^)  *  0(kp  )  ♦  0  as  k  ♦  «•  and  the  second  term  is 


bounded  by  (2e  +  £2)k28  3Tk  with  k28  Vk  being  bounded  in  k.  Thus  fk  ~  Tk  as 


k  ♦  «*  and  the  result  follows. 


The  converse  of  Lemma  1  is  not  true.  For  example  if  (2)  and  (4a)  hold  and  =  0 

—6 

if  j  =  2m  for  some  positive  integer  m,  “  j  otherwise,  then  it  is  easy  to  show 

that  (1)  is  still  true. 

An  outline  of  this  report  is  as  follows.  In  Sections  2,  3  and  4  we  derive  the 
asymptotic  properties  of  the  sample  mean,  autocovariances  and  autocorrelations 
respectively.  The  cumulants  of  two  non-Normal  distributions  arising  from  the  asymptotic 
theory  of  Sections  3  and  4  are  investigated  in  Section  5.  In  Section  6  we  apply  our 
results  to  the  family  of  fractionally  differenced  ARIMA(p,d,q)  processes,  a  particularly 
widely  known  class  of  lon<g-memory  time  series.  Section  7  contains  some  indications  of 
possible  extensions  of  our  results. 
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2 


THE  SAMPLE  MEAN 


The  sample  mean  of  a  realization  ryt  :  t  =  1,...,n'  of  a  time  series  is 


and  has  mean  u  and  variance 


-1 

y  =  n  '  y 
t=1 


n  n 

r  y  =  n~2  \  ^  Y 


var  y 


-2 


n  ^ 2  )  (n  -  t )  Y  +  ny  l 

t-1  u-1  t_U  t«1  1  ° 


(5) 


Lemma 


Let  fyt  :  t  =  1,...,nl  be  a  sample  from  a  second-order  stationary  time  series  whose 


covariance  function  satisfies  (1).  Then 


var  y 


2'  n 


!  1-0 ) (2-n) 


as  n 


Proof,  write  (5)  as 


var  y  =  2n  n*n  ^  ( 1  -  — +  n  Y 

t-1  "  ° 


As  n  ♦  <”  the  sum  n  1  '  (1  -  t/nln^Y^  converges  to  the  integral 


f  (1  -  t)Xt~adt  =  vf(1  ~  n){2  -  . 


Since  n  %  =  o(n  as  n  +  «•  the  result  follows. 

Theorem  1 . 


Suppose  that  the  time  series  fy  1  satisfies  f  1 )  —  { 3 )  and  (4a).  Then 


na/2(y  -  1< )  -->  N(0,2>/f(1  -  nt )  { 2  -  a )  1 )  as  n 


Proof.  Since  •*> .  =  0(j  with  ot  >  0 ,  we  have  ^  <  ".  Furthermore,  fr 

-  3  J 


Lemma  2 , 


The  result  now  follows  from  Theorem  IP. 6. 5  of  Ibragimov  and  Linnik  (1971). 

Note.  The  proof  of  their  Theorem  18.6.5  qiven  by  Ihraqimov  and  Linnik  (1971)  is  defective, 
but  can  easily  be  corrected,  as  indicated  in  the  Appendix  to  this  report. 

Remark .  Theorem  1  is  also  valid  if  {yfc }  satisfies  (2)  and  (4a)  and  has  an  autocovariance 
function  Y,  with  Y„  <  ®,  Y.  ~  Xk”°,  X  <  0,  1  <  a  <  2.  The  proof  is  unaltered. 


3.  SAMPLE  AUTOCOVARIANCES 


We  define  the  sample  autocovariances  of  a  realization  {y  :  t 
series  by 


-1 


n-k 


Ck  =  n 


l.  (yt  -  y,(yt+k  '  y>< 


0,1,, 


t=1 


1 , . . . , n}  of  a  time 


1  . 


Other  definitions  of  sample  autocovariance  have  been  used  by  some  authors,  but  the  more 
common  variants,  for  example  those  defined  by  Anderson  (1971,  chapter  8),  differ  from  c^ 
by  quantities  of  stochastic  order  Op(n-1)  and  have  asymptotic  properties  identica.  to 
those  of  c^.  We  also  define 

1  n*k 

Ck  =  "  J,  (yt  -  U,(yt+k  -  k  =  °'1 . "  •  1  f 


these  quantities  are  estimators  of  when  the  sample  mean  is  known.  For  short-memory 

processes  the  asymptotic  distributions  of  c^  and  c^  are  identical.  For  long-memory 
processes  with  autocovariance  function  (1)  this  is  only  true  if  V2  <  a  <  1.  When 
0  <  a  <  V2  ,  replacement  of  u  by  y  has  an  effect  which  is  not  negligible  even  in  large 
samples,  for  it  introduces  a  bias  into  the  estimated  autocovariances  which  is  of  the  same 
order  of  magnitude  as  their  standard  deviation. 

Theorem  2 . 


Let  {yt }  be  a  stationary  time  series  satisfying  (1).  Then  the  asymptotic  bias  of 
c^  is  given  by 

-91r.-a 

as  n  ♦  •  .  (6) 


_  -21n 

Eck  "  Yk  ~  (1  -  a) (2  -  a) 


If  in  addition  {yfc}  satisfies  (2),  (3)  and  (4b),  then  the  asymptotic  covariance  of  the 
is  given  by 

r 

if  0  <  a  <  V2  ,  (7a) 


cov(ck,ct)  ~ 


2A2K2n~2a 


4X2n  ^log  n 


if  a  =  V2  . 


n"  I  i  (YsVk-*  +  VkVl’  +  <YkYi*  if  V2  <  a  <  1  f 


(7b) 


(7c) 


where  K-,  is  as  defined  in  Theorem  3  below 


Proof .  To  find  the  bias  of  c^  we  write 


~  2  -1  -  k  k 
c  =  c  -  (1  +  k/n)(y  -  u)  +n  (y  -  u|l  )  (y  -  u)  +  )  (y  1  —  li)l^  (8) 

*  *  t=1  C  t=1  n-t 


The  first  term  on  the  right  side  of  (8)  has  expectation  +  0(n  ),  the  second  term  is 

of  order  o  (n  a)  and  has  expectation  -2Xn  a/f(1  -  n)(2  -  <t)l  +  o(n  °)  by  Lemma  2,  and 
P 

the  third  term  is  of  order  0^(n  '  n^)  antj  is  asymptotically  negligible.  Hence  we  deduce 

(6). 

To  establish  (7)  we  consider  the  cases  0  <  a  <  V2  ,  a  *  V2  and  V2  <  «  <  1 
separately . 

First  suppose  0  <  a  <  V2  •  The  covariance  of  c^  and  cf  is  given,  apart  from  terms 
of  order  n”^,  by  Anderson  (1971,  p.  452,  equation  (65)).  The  expression  involves  terms 
arising  from  the  variance  and  kurtosis  of  fat'.  The  variance  terms  are  the  same  as  if 
fafc)  were  Normally  distributed  and  sum  to  2X2K2n  2<I  asymptotically,  as  shown  in  Theorem 
3  below.  To  prove  (7a)  we  must  show  that  the  kurtosis  terms  make  an  asymptotically 
negligible  contribution  to  cov(ck,cf).  These  terms  are 


ten  ^  )  f  )  i(i  i!j  i(i  1I1  -  n  )  )  to  lb  1I1  ill 

'  ,  .  .  i  i+k  i+u-t  i+t+u-t  ,  .  .  i  i+k  i+u-t  i+f.+v-t 

t=1  u=1  i=0  v»1  i=“0 


n  n  " 


-  n  1  )  \  lb.*..,*..  +  n  2  )  )  )  *.  * 

.  .  »  i  i+*  i+u-t  i+k+u-s  '  .  .  .  i  : 


s*  1  i“0 


8“1  V”1  i“0 


i+k+u-s^i+u-t^’i+t+v-t^  ' 


where  ill .  =  0  for  j  <  0.  Now  since  * .  ~  vj  as  j  +  »  we  have  di .  <  *  for  all 

3  3  3  1  3 


constant.  Note  that  f9^  :  j  >  O  is  a  positive  decreasing  sequence.  Thus 


i  \  ^  "  i,  1,  ,in  TiWi+u-tfi*fu-t 

t=1  U=1  1=0  t=1  u=1  i=0 

-  n_2in  i  ’I’inVt  +  ni  *i’i+k»i+u.t*i+l+tt-t  +  m 

1  t<U  1  t>U  1 


*  n'2  5  )  l  'f2*2  L  , 

r  L  r  i  i+lt-uf 


n  n  «  °° 

<  n  2  l  III  1  'fi+|t_..N1/2  hy  Cauchy’s  inequality 

t=1  u=1  i=0  i=0  1  1 


=  o'1  1  fj  ♦  2n-2(  1  <)V2  1  (n  -  t>(  1  *«+t)1/2  . 

i-0  i=P  t=1  i=0 

Now  Y4  =  0( i  4^),  so  \  f4  <  — ,  g2  S  ^  f4  =  Oft1  4®)  and 

1  i=0  1  fc  i-o  1+t 

1  (n  -  t)g  =  n)q  -  ]_tg  =  0(n5/2_2e>  . 
t=1  r 

Thus  the  first  term  of  (9)  is  0(n1/<2  2®)  =  0(n  1,22  °)  =  o(n  2a).  A  similar  argument  shows 

1  /2  **26 

that  the  other  terms  of  (9)  are  0(n  )  also.  For  example  for  the  second  term  we 


4  %1/2 


in*3 1  m  *i*1+kwt*1+t+v.tl  in  i  Vi^Vu-tV^v-t 


<  HKl  Vi«c*i+u-J  "U  Vi+kWv-J  (Cauchy’ s  inequality) 

t  u  v  i  i 

i  n  n  o 

<  n  3  )  [  >  h  )2 

„L,  1  t~u 

t=  1  u=  1 


where  hfc  =  0(t  )  as  t  +  whence  an  argument  like  the  above  shows  that  this  term 

1 /2-26  _2a 

too  is  of  order  0(n  '  ).  Thus  (9)  as  a  whole  is  of  order  o(n  )  and  this  proves 


Next  suppose  u  -  V2  •  First  we  consider  cov(c  ,c,  ):  we  have  (cf.  Anderson,  1971, 


p.  4S1  ) 


__  __  n-k  n-t 

,tck'ci'  n  ^  ^  ^Yt-uYt-u+k-i  +  Yt-u+kYt-u-i 

t- 1  u-1 


+  k  X  Vi+kWtWu-J  ■ 

i-0 


The  terms  involving  Yj  in  (10)  yield 


n-k  n-i 


""  A  K  <Wt' 


+  Y  Y  ) 

u+k-i  t-u+k  t-u-i 


X  K  <Yt-uYt- 

t-1  U- 1 


•u*k-i  *  Yt-u+kYt-u-*>  88  n 


n“1(Y0Yk-i  +  YkV  +  n"2  M  (Yt-uYt-u+k-i  +  Yt-U+kYt-uV 

t*u 


n_1(Y0Yk_4  +  Y^)  +  2n  *  l  (n  -  t){2X2t_1  +  o(t-1)} 

t-1 


-1/2 

since  Yk  ~  Xk  as  k  ♦  «.  Asymptotically  the  dominant  term  in  (11)  is 

4X2n-1£t-1  ~  4X2n-1log  n;  the  other  terms  are  asymptotically  negligible.  The  identical 
argument  to  that  used  in  the  case  0  <  O  <  Vi  above  shows  that  the  kurtosis  term  in  (10) 
is  0(n-1)  «  o(n~^log  n),  so  we  have  proved  that 

o,  2-1 

cov(ck,c4>  ~  4X  n  log  n  as  n  ♦  “  ,  (12) 


and  hence  that  ck  ie  of  stochastic  order  n-1/^2(log  n)1^2.  Now  from  (8)  it  follows  that 

c.  -  c  -  0^.(n"1/|,2)  because  by  Lemma  2  (y  -  y)2  -  0  (n-1^2).  Thus  replacement  of  c 
k  P  P  k 

by  ck  has  an  asymptotically  negligible  effect  and  (7b)  follows  from  (12). 

Finally  when  V2  <  a  <  1,  the  sum  of  squared  autocovariances,  IYk>  is  convergent. 
Thus  the  spectrum  of  the  process  is  square-integrable  and  (7c)  follows  from  the  central 


limit  theorem  of  Hannan  (1976). 
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Let  (yt)  be  a  time  series  satisfying  (1)-(3). 

(i)  If  0  <  ct  <  V2  and  (4d)  holds,  let  =  na(ck  "  Y^);  then  as  n  +  ®, 

Ck  -  c  S>  0  for  k  *  i  and  the  common  limiting  distribution  of  the  Ck  has  rth 
cumulant 

Kr  =  Xr2r-1(r  -  1)lKr  (13) 

where 

K1  =  -2/ { ( 1  -  a) (2  -  a)}  ,  (14) 


1  1 

Kj.  =  f  .../  g(x1  ,x2  )g(x2,x3  ) . .  •g(xr_1  ,xr  )g(xr  ,x1  Jdx^  .  .dxr ,  r  >  2  ,  (15) 

0  0 


with 

j(x,y)  =  |x  -  yl““  -  {x1-a  +  ( 1 -x ) 1 +  y1_a  +  ( 1-y) ’““j/t 1-a)  +  2/{ ( 1-a )  (2-a  )}  .  (16) 


(ii)  If  a  *  V2  and  (4d)  holds,  let  Ck  ■  (n/log  n)^/2(ck  -  Yk>»  then  as  n  -*• 

ck  -  Cj  0  for  k  *  l  and  the  common  limiting  distribution  of  the  Ck  is  N(0,4X2). 

(iii)  If  V2  <  a  <  1  and  (4b)  holds,  let  Ck  *  n1/>2(ck  -  Y^);  then  as  n  ♦  •  any 
finite  subset  of  the  Ck  has  a  limiting  distribution  which  is  multivariate  Normal  with 
mean  zero  and  covariances  given  by  (7c). 

Remark .  Rosenblatt  (1979)  proved  the  corresponding  result  to  Theorem  3 ( i )  for  the 
asymptotic  distribution  of  the  autocovariances  c^  calculated  assuming  the  mean  u  to  be 
known.  The  limiting  distribution  is  the  same  as  that  defined  by  ( 13)  —  ( 16)  except  that  the 
function  g(x,y)  is  replaced  by  g(x,y)  =  lx  -  y|  °.  These  distributions  are  further 
discussed  in  Section  5. 

Proof .  (i)  We  adapt  Rosenblatt's  (1979)  proof  of  his  proposition  to  the  case  in  which  the 

sample  mean  is  estimated.  Write  =  yt  -  y  so  that 

n-k 

ck  =  n_1  1 

t=1 
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(n)  (n) 


For  fixed  n,  the  vector  z(n)  '  (*^n> • • -*in> )T  hae  a  degenerate  multivariate  Normal 
distribution  with  mean  zero  and  covariance  matrix  0  “  (wst),  vrtlere 


^  ,  n  n  n  n 

ui  -  Y  ^  -  n’  V  Y  -  n”  ).  Y,.  +  n  V  5  Y 

st  s-t  L.  s-u  L,  't-u  L,  L.  'u-v 

U”  1  U“  1  U“  1  V"  1 


and  rank  fl  »  n  -  1.  The  joint  characteristic  function  of  C^,  k  «  0,1,  ...,£,  can  be 
written  as  |l  -  2iLTAL!-1^  where  ft  -  LLT,  L  is  an  n  *  (n  -  1)  matrix  of  full 
column  rank  (Searle,  1971,  p.  68),  and 


A  -  n““  l  tkJk 


0  1  0  ...  0 

0  0  1 


For  r  >  2,  a  typical  rth-order  cross-cumulant  of  this  distribution  looks  like 


2r-\r  -  1).n“r-r  l  l  u. 


>  )  ,  .  e  e  .  0)  .  ,  .  0)  .  . 

j  -1  j  -1  Ji+a1»J2  j2  2'j3  VlVl'jr  V*rf31 

J1  Jr 


where  a1,...,aj_  take  on  values  0,1,  ...,i.  As  n  “  all  these  rth  order  terms  have  the 
same  limit,  this  limit  being  (15)  with 

1  1  1  1 

g(x,y)  »  |x  -  y|_a  -  /  |x  -  u|  “du  -  J  I y  —  y I  °du  +  /  /  |u  -  v|  dudv  .  (17) 


It  is  trivial  to  show  that  (16)  and  (17)  are  equivalent.  That  ECk  ♦  follows  from 
Theorem  2.  To  complete  the  proof  we  must  show  that  the  cumulants  ( 13)— ( 16)  define  a  unique 
distribution.  We  have  by  Cauchy's  inequality  for  integrals  that 
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tt..  rr 


,K!r,  .  .< 


a  ... 
0 


=  Kr 
K2  ' 


2(x1(x2)g2(x3,x4)  ...  <32(x2r.1<x2r)dx1  •••  dx2rlV2  * 


I  2.  .  2,  ,  2,  .  s'*/! 

1  9  <x2*x3>  g  (x2r-2'X2r-1  9  <x2r'x1>dx1  •••  dx2r’ 


and  similarly  that 


1  1  1  , 

<2  ,  I  <  K2"  2  f  f  f  g2(x1(x2)g  (x2,x;j)dx1dx2dx3  . 

0  0  0 


Noting  that  g(x,y)  -  |x  -  y|  n  is  bounded  for  0  <  x  <  1,  0  <  y  <  1  we  can  use 
Rosenblatt's  (1979)  equation  (19)  to  show  that  for  some  constant  C,  | Kr |  <  CKj^2  for 
all  r.  Thus  the  joint  characteristic  function  of  Cq ,C1 , . . . ,C^  is  analytic  in  a 
neighbourhood  of  the  origin  and  the  distribution  defined  by  ( 13)— ( 16)  is  unique. 

(ii)  When  n  =  V2  the  statistics  ck  and  are  asymptotically  equivalent,  as 

shown  in  the  proof  of  Theorem  2,  so  to  prove  Theorem  3 ( i i )  it  is  sufficient  to  establish 

1/2  ^ 

the  asymptotic  joint  Normality  of  *  (n/log  n)  (c^  -  Y^),  k  “  0,1,...  ,1  .  By 
following  the  approach  of  Rosenblatt  (1979,  p.  127)  we  see  that  a  typical  rth  cross- 
cumulant  of  the  joint  distribution  of  CQ,...,Cf  looks  like 

-r/2  n  " 

u_  *  2r~ 1 ( r  -  1 ) ! (n  log  n)”r  V  V  y .  Y  ...  y  y 

j  =1  j  =1  31  1  J2  J2  2  ^ 3  3r-1  r-1  jr  3r  r  j1 

j  1  Jr 

where  n.,...,a  take  on  values  0,1,..., f. .  We  will  show  that  for  r  >  3  these  cumulants 
1  r 

tend  to  zero  as  n  ♦  ®.  We  take  =  . ..  =  a  =  0  for  convenience  but  our  proof  is  also 
valid,  with  minor  modifications,  when  the  (V  are  not  all  zero.  By  Cauchy's  inequality  we 


I  ur |  <  2r_1 ( r- 1 ) ! <n  log  n)"r/2  V 


V  Y2  I Y .  I 

j  =1  ^l”^2  32  9 3 


.  .  .  Y  . 

WV 


-1/2 

Now  Yj  -  0(j  )  as  j  ♦  «•,  so  for  1  <  j  t  n 


n  j-1  n-j 

V  ,Yi-jl”v0+  '  lvi'  *  '  |vil 

i-1  3  i-1  1  i-1  1 


(19) 


<  on  *  jV2  ♦  („-j>1/2>  c  3C„1/2  -  0(n1/2> 


for  some  constant  C  >  0,  since  V  i_1/2  m  o(j1//2)»  similarly 

i-1 


V 

i-1 


v 

i-1 


2  "“J 

Y  ♦  ) 

i-1 


Y 


2 

3 


<  C’fl  +  log  j  +  log(n-j)'  <  3C’log  n  “  O(log  n) 


(20) 


for  some  constant  C’  >  0,  since  )  i-1  -  O(log  j).  summing  (18)  over 

i-1 

successively  and  using  (19)  and  (20)  we  have 

ur  »  (n  log  n)“r ^2  •  0< log  n)  •  0(n*r”2'^2)»n  -  OUlog  n)3“*/2) 

and  so  ur  ♦  0  for  r  >  3.  Thus  the  ,  and  by  asymptotic  equivalence  the  ck  also, 
are  asymptotically  jointly  Normal  and  Theorem  3(ii)  follows,  the  variance  of  the  limiting 
Normal  distribution  of  Ck  being  obtained  from  Theorem  2. 

(iii)  when  V2  <  n  <  1,  *yfc^  satisfies  the  conditions  of  the  central  limit  theorem 
of  Hannan  (1976),  as  remarked  in  the  proof  of  Theorem  2  above,  and  Theorem  3(iii)  follows 
in  consequence. 
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r"vr»  -v  ■  "w 


4.  SAMPLE  AUTOCORRELATIONS 

The  autocorrelations  of  the  time  series  (yt)  are  the  quantities  pk  -  y^Aqi  and 
are  estimated  from  an  observed  series  {yfc  :  t  -  1,...,n}  by  the  sample  autocorrelations 


r 


k 


l  <yt  -  y)(yt +k  -  y)  /  l  (yt  -  y)2 

t-i  t-i 


ck/c 


o  • 


as  with  the  sample  autocovariances,  a  number  of  asymptotically  equivalent  variants  of  rk 
may  be  defined.  The  asymptotic  properties  of  sample  autocorrelations  are  qualitatively 
similar  to  those  of  sample  autocovariances.  For  long-memory  time  series  with 
autocovariance  function  (1),  the  same  trichotomy  as  in  Section  3  applies:  for 
V2  <  a  <  1,  rk  has  the  "standard  asymptotic  behaviour"  of  asymptotic  Normality  and 
variance  of  order  n~^>  for  a  -  ^  ,  rk  is  asymptotically  Normal  but  with  variance  of 
order  n-1log  n>  and  for  0  <  a  <  ,  rk  has  variance  of  order  n  2a  and  an  asymptotic 

distribution  which  is  not  Normal. 

Theorem  4 

Let  {ytl  be  a  time  series  satisfying  (1)-(3)  and  (4b).  Then  the  asymptotic  bias  and 
covariance  of  the  rk,  k  >  1,  are  given  by 


Er 


-2(1  -pfc> 


k  k  (1  -  a) (2  -  a)  y 


X  -a 

•  n  as  n  ♦ 


cov(VV  ~ 


2(X/y0)2(1  -  py)(1  -  Pl)K2n"2“ 


if  0  <  a  <  vi  $ 


4(XA0)2(1  -  Pk)(1  -  Pjt)n"1log  n  if  a  -  Vfe  , 


(21a) 

(21b) 


f  l  (PsPe*k-l  +  PsPs+k+i  +  4(Ws  -  2pkpsps+i  -  2ptpsps+k^  (21c) 

8“*® 

if  V2  <  <*  <  1  ' 


where  K2  is  as  defined  in  Theorem  3. 
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Proof .  write  rk  -  ok  •  (c^  -  Dkcg)/co‘  The  results  then  follow  from  Taylor  expansion  of 
the  ck  about  their  expectations  y^,  using  Theorem  2  above  and  the  techniques  of  Fuller 
(1976,  Section  5.4). 

Theorem  5 

Let  <y  »  be  a  time  series  satisfying  (1)-(3). 

(i)  If  0  <  a  <  V2  and  (4d)  holds,  let  »  n^r^  ”  <7^ >/ < 1  "  Pk)(  then  as  n  *  •», 

Rk  -  Rp  — ^>  0  for  k  *  I  and  the  common  limiting  distribution  of  the  Rk  has  rth 
cumulant  Ygr<r  where  is  defined  by  (13)-(16). 

(ii)  If  a  ”  V2  and  (4d)  holds,  let  Rk  »  (n/log  n)1/,2(rk  -  o^J/d  -  Pk)»  then  as 

n  *  •,  Rk  -  -^>  0  for  k  *  t  and  the  common  limiting  distribution  of  the  Rk  is 

N(0,4(X/Yg)2). 

(iii)  If  V2  <  a  <  1  and  (4a)  holds,  let  Rk  -  n1/,2(rk  -  t >fc)»  then  as  n  ♦  •  any 
finite  subset  of  the  Rk,  k  >  1,  has  a  limiting  distribution  which  is  multivariate  Normal 
with  mean  zero  and  covariances  given  by  (21c). 

Proof .  First  suppose  that  0  <  a  <  V2  •  Writing  rk  "  °k  “  ^ck  ~  Yk*  ”  pk*c0  ”  Y0^/,°0 
we  have 

Rk  “  c01(Ck  _  Pkco,/(1  "  °k)  t22> 

where  ck,  CQ  are  as  defined  in  Theorem  3(i).  From  that  theorem  it  follows  that 

Ck  -  okCg  has  the  same  limiting  distribution  as  (1  -  Pk)CQ  and  this  together  with  the 

result  that  eg  *  Yg  almost  surely  (Hannan  and  Heyde,  1972)  implies  that  Rk  has  a 

limiting  distribution  which  is  identical  to  that  of  Yg’Cg  and  hence  has  rth  cumulant 

Y:rr  where  k  is  defined  by  (13)-(16).  From  (22)  we  also  have 
Or  r 

Rk  -  R«  ■  co1f(ck  '  co,/(1  -  V  '  tc»  “  V/(1  -  *t" 

and  since  Ck  -  Cg  0,  C,  -  CQ  -B>  0  and  c0  — >  Yg  almost  surely  this  in^lies  that 
Rk  -  Rf  -E>  0.  This  completes  the  proof  of  (i). 

The  proof  of  (ii)  is  almost  identical  to  that  of  (i):  only  the  limiting  distribution 
of  Cg  Is  different. 

To  prove  (iii)  we  note  that  j ^2* 2  ■  Olj'^2  2  )  and  that  ”  24  <  *1.  Thus 
and  (iii)  follows  from  Theorem  3  of  Hannan  and  Heyde  (1972). 


rjl/2^  <  - 


CUMULANTS  OF  NON-NORMAL  ASYMPTOTIC  DISTRIBUTIONS  OF  SAMPLE  AUTOCOVARIANCES  AND 


AUTOCORRELATIONS 

The  non-Normal  asymptotic  distribution  of  sample  autocovariances  and  autocorrelations 

derived  in  Theorems  3(i)  and  5(i)  above,  is  similar  to  the  limiting  distribution  of 

na(c^  -  y  )  for  a  process  satisfying  (1)  with  0  <  a  <  V2  »  obtained  by  Rosenblatt 

(1979).  Rosenblatt's  distribution  has  rth  cumulant 

K  =  Xr2r_1 (r  -  1) !I  (23) 

r  r 

where 

I,  =  0,  (24a) 


1  1 
I  .../ 

0  0 


r-1 


x^ I  adx 1 . . .dx^ ,  r  >  2 


(24b) 


It  is  of  interest  to  evaluate  some  of  the  lower  cumulants  of  this  distribution  and  of  its 
modified  version  with  cumulants  defined  by  (13)- (16),  in  order  to  see  how  far  from  Normal 
these  distributions  are.  TYie  following  theorem  gives  some  analytic  expressions  for  the 
integrals  which  define  these  cumulants. 

Theorem  6. 

Let  Ir  be  defined  by  (24)  above  and  1^  by  < 14)— ( 16)  above.  Let 


Jr-1 


1 


/ 

0 


1 


./  |x 


1 


|  x  ,  -  x  |  adx 
'  r-1  r1 


1* 


.dx 


1,2,. 


i.e.  Jr_i  is  similar  to  Ir  but  with  the  term  |xr  -  x^|  a  omitted  from  the 
integrand.  Then 


12  =  1/ { ( 1-u) ( 1-2o) }  , 

13  =  4r2(1-a)/{(2-3a>r(3-2a)} 


x4 


6f3  ( 1-a)  +  1 _  |  1,a,2-2a 

(3-4a>r(4-3a)  (1.a)3(3_4a)  3  2  L2-a,3-2a 


2T2 (2-2a ) 

( 1-a)3r (4-4a)  3  2 


1,a,a  | 
'  2-a ,  2-a 


K,  *  I,  -  2J,  +  J?  , 


(25) 

(26) 


1 2  “  3Jj  +  3J 2*7  ^  —  *7 3  , 


(27) 


K4  -  I4  -  4J4  +  4J3J,  ♦  2J2  -  4J2J?  +  J4  I 


J,  -  2/{<1-a)(2-a)}  , 

J2  -  2r2(1-a)/r(4-2o)  +  2/1 ( 1-a) 2( 3-2a) }  , 


_  2r3(1-o)  +  4f2 (1-a) 

3  "  P(5-3a)  (1-a) (4-3ajr(3-2a) 


( 1-a)  (3-2a ) 


3F2  l 


]  . 


2r4(1-a)  . _ 

J4  T(6-4a)  (1-a) (5-4a)r(4-3a) 


4f  (1-a) 


2T  (1-a) 


1,a-1,3-2a 
2-a,4-2a 

_  „  [1,a-1,4-3aj 


(1-a )2 (4-3a )T( 3-2a)  3  2  3-2a,5-3a 


_ 4 _ 12r(1-a)r(3-3a)  )  r1,a,3-2a, 

( 1 -a )3 ( 3-2a , ( 5-4a )  < ^ ( 3-2- ) f (6-4a )  ■ '  3F2  l2-a,4-2aJ 


+ - 5 -  /  t1“aF<1,a>2-ait)F(a-1,4-3ai5-3a»t)dt 

(1-a)  (4-3a)  0 

*  8(1-a"r(5-3a°}  J  t1_aF(  1  ,a»2-ajt)F(a-1,3-2a, 5-3a;t )<Jt  » 
here  F(a,8iY»x)  is  the  hypergeometrlc  function  end 


(28) 


_  rl.a.Bi  -  Uy)T(6)  y  rnta>r( i+B ) 

32  1  y.«  J  ‘  r(a>r(B>  nj+Y)r(j+«) 

is  a  generalized  hypergeooetric  function  of  unit  argument  (Bailey,  1935). 

Proof.  The  proof,  which  ia  tedious  but  not  difficult,  is  not  given  in  detail.  To  prove 

(26)- (28)  we  substitute  g(z,y)  from  (17)  in  (15)»  the  resulting  expressions  for 

r  »  2,3  and  4  simplify  to  (26)-(28)  respectively.  To  evaluate  the  integrals  for  Ir 

and  Jr  we  break  the  region  of  integration  into  sections  of  the  form 

0  <  x,  <  ...  <  x.  <1  for  i1,...,ir  a  permutation  of  1,...,r,  and  within  each 
1  r 

section  integrate  over  x.  ,...,x.  in  some  convenient  order.  For  each  integration  we 

1  r 

transform  the  dummy  variable  so  that  the  range  of  integration  is  (0,1)  and  use  the 


expressions 


/  ta_1(1  -  t)8-1dt  -  B(a,B)  -  rta)r(B)/r(a  +  B )  , 
0 


/  ta_1<1  -  t)8-1(1  -  xt)'Ydt  -  B(a,B)F(a,r>a  +  Six)  , 

0 


/  ta-1(1  -  O^Vy.fiieitJdt  -  B(a,B>  3F2 


(Gradshteyn  and  Ryzhik,  1980,  pp.  284,  286,  849).  As  an  example  of  the  method  we  prove 
(25).  He  have 


1111 

I 4-/  /  /  /  I*,  - 


0  0  0  0 


X2l"a|X2  "  *3!  ”a|x3  ”  X4 1  ~ *  I  x4  "  I"<*dx,dx2dx3dx4 


and  using  the  symmetry  of  the  Integrand  under  the  cyclic  transformation 
x1  ♦  x2  ♦  x3  +  x^  ♦  x1  we  can  break  up  the  Integral  as 


/  4-8  /  +8  /  ♦  8  / 

[0,1]  x1>x2>xJ>x4  X1>X2>X4>X3  X1>X3>X2>X4 


For  the  first  term  we  perform  the  successive  Integrations 


I  (x,  -  Xjl^Xj  -  Xjl^dXj  -  (xt  -  x3)  2aB(1-a,1-a)  , 


/  (x  -  x,)1  2“(x,  -  x.J^dx,  »  (x,  -  x  )2  JaB(  1-a,2-2a)  , 
13  343  14 


/  /  (x1  -  x4)  °dx  dx1  -  1/{ (3-4a ) (4 -4a '} 

0  0 


thus  the  first  term  of  (29)  is  8B( 1-a, 1-a)B( 1-a,2-2a) /( (3-4a) (4-4o ) } ,  which  simplifies  to 


the  first  term  of  (25).  The  second  term  of  (29),  after  the  integrations 
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t  <X1  "  x2*  a^x2  ”  x3)  a^X2 
X4 

=*  (x  -  x  )1_r,(x  -  x  )_a(1  -  a)-1F(1,ai2  -  a;  (x  -  x  )/(x  -  x, ) ) 

1443  4143 


=  (X,  -  x4)1  a(x1  -  x3,-«(1  -  o)-1F(n,1  -  n>2  -  -  x<)/(x1  -  Xj)) 


where  we  have  used  9.131.1  of  Gradghteyn  and  Ryzhik  (1980,  p.  1043), 


f  (X,  -  X.)1  2“<x.  -  X- )  aF(<t,1  -  n;2  -  a;{x  -  x.)/(x,  -  x, )  )dx, 
14  43  14134 


(x  -  x  )2  3n  I  t  a(1  -  t)1  2™F(n,1  -  a;2  -  nil  -  t)dt 
J  0 


(X1  -  x3)2-3aB(1  -  a, 2  -  2«)  3f2  , 


yields 


1  *  <X1  ”  X3 1  ^dXjdx^  »  1/f(3  -  4a)  (4  -  4o)>  , 

0  0 


8B(1-n,2-2n)  „  (-0,1-0,2-201 

[  1-a)(3-4o)(4-4a)  3  2  2-n,3-3a  ' 


which  reduces  to  the  last  term  of  (25)  after  the  application  of  a  transformation  of  the 
jFj  function  given  by  Bailey  (1935,  p.  98).  Similarly  the  last  term  of  (29),  after 
integrations  over  X2,x3,x4  and  xj  successively,  yields  the  second  term  on  the  right 
side  of  (25).  This  completes  the  proof. 


we  have  used  Theorem  6  to  evaluate  the  cunulants  up  to  fourth  order  of  the  Rosenblatt 
and  asK>dified  Rosenblatt*  distributions,  whose  cumulante  *r  and  Kr  are  defined  by  (23)- 
(24)  and  (16) -(19)  respectively.  The  results  are  presented  in  Table  2  for  X  «  1  and 
various  values  of  o  in  the  range  0  <  o  <  V2  •  The  values  I2,  I3  and  I4  have  also 


'  •  v.v 
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been  calculated  by  Mandelbrot  and  Taqqu  (1979!  usinq  a  less  accurate  method.  It  can  be 


seen  that  the  modified  distribution  is  closer  to  Normal  than  the  original  Rosenblatt 
distribution,  and  that  both  distributions  approach  Normality  as  n  *  V2  .  It  is  also 
apparent  from  Table  2  that  the  mean  of  the  modified  Rosenblatt  distribution  greatly  exceeds 
the  standard  deviation  in  absolute  value  if  n  <  0.3.  Thus  for  a  time  series  with  an 
autocovariance  function  (1)  and  a  <  0.3,  the  vast  majority  of  realizations  of  the  series 
will  have  a  sample  autocorrelation  function  which  even  for  large  samples  significantly 
underestimates  the  true  autocorrelation  function  of  the  time  series.  The  use  of  the  sample 
autocorrelation  function  to  identify  such  processes  may  therefore  be  very  unreliable. 

Table  2.  Standardized  cumulants  of  the  Rosenblatt  and  modified  Rosenblatt  distributions. 

Cumulants  defined  by  ( 23 ) — ( 24 )  and  f 16}— ( 19)  respectively,  with  X  =  1. 

3/2  2 

Skewness  *  x,/x„  ,  kurtosis  =  x./x.  -  3. 

3  2  4  2 


n  :  0.02 

0.10 

0.20 

0.30 

0.40 

0.48 

Rosenblatt 

distribution 

Mean 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Std.  dev. 

1 .46 

1 .67 

2.04 

2.67 

4.08 

9.81 

Skewness 

2.83 

2.77 

2. SB 

2.07 

1.18 

0.17 

Kurtosis 

11.99 

11.66 

10.35 

7.63 

3.39 

0.23 

Modified  Rosenblatt  distribution 


Mean 

-1.03 

-1.17 

-1.39 

-1.68 

-2.08 

Std.  dev. 

0.032 

0.20 

0.55 

1.21 

2.82 

Skewness 

1.37 

1.20 

0.95 

0.67 

0.33 

-2.53 

9.12 

0.04 

0.02 


6.  FRACTIONALLY  DIFFERENCED  ARM A  PROCESSES 


Recent  interest  in  long-memory  time-series  models  has  been  particularly  stimulated  by 
the  family  of  ARIMA(p,d,q)  processes  in  which  the  differencing  parameter  d  is  permitted 
to  be  any  real  number.  These  processes  have  been  discussed  by  Granger  (1980),  Granger  and 
Joyeux  (1980),  Hosking  (1981,  1984),  Geweke  and  Porter-Hudak  (1983)  and  Li  and  McLeod 
(1984).  It  is  therefore  of  interest  to  apply  our  previous  results  to  this  class  of 
processes. 

A  time  series  {yfc}  is  an  ARIMA(p,d,q)  process  if  it  can  be  written  as 

♦<B)7d(yt  -  y)  -  8(B)at  (30) 

where  u  is  the  mean  of  the  process,  Vd  is  the  fractional  differencing  operator 
(Hosking,  1981,  equation  (2.1)),  ♦(B)  “  1  -  $^B  -  ...  -  ♦pB**  and 

0(B)  -  1  -  8  B  -  ...  -  8  Bq  are  polynomials  of  degree  p  and  q  respectively  in  the 
1  <1 

backward-shift  operator  B  defined  by  By ^  -  Yt-1'  and  {afc}  is  a  white-noise  process 
consisting  of  independent  and  identically  distributed  random  variates  with  mean  zero  and 
variance  o2.  An  ARIMA(p,d,q)  process  is  stationary  if  d  <  V2  and  all  the  rootB  of  the 
equation  8(z  ')  »  0  lie  inside  the  unit  circle  |z|  •  1  (Hosking,  1981).  It  is 
straightforward  to  show,  using  the  approach  of  Theorem  2  of  Hosking  (1981),  that  a 
stationary  ARIMA(p,d,q)  process  with  d  *  0  has  an  autocovariance  function  which  satisfies 


T 


k 


o2fu(0)r(i  -  2d)  2d_, 
r< d )T(  1  -  d)  k 


(31) 


and  an  infinite  moving-average  representation  (2)  with 

{f  <0  )} 1/2 


d-1 


here 


*j - TTdi —  3  as  3  * 


fu(0)  -  (1  -  81  -  ...  -  0  )  /(I  -  - 


V 


(32) 


is  the  spectral  density  at  frequency  zero  of  the  process  $(B)ut  ”  8(B)at,  the  "ARMA  part" 
of  the  ARIMA(p,d,q)  model.  We  see  that  for  0  <  d  <  V2  the  ARIMA(p,d,q)  processes  are 


stationary  long-memory  processes  whose  autocovariance  functions  have  the  power-law  decay 


(1)  with  exponent  a  -  1  -  2d.  Thus  Theorems  1-5  above  are  valid  for  ARIMA(p,d,q) 
processes • 

Hosking  (1981)  suggests  that  the  range  of  values  -  Vi  <  d  <  Vi  may  be  of  particular 
interest  when  using  fractionally  differenced  AFMA  processes  for  time  series  modelling.  He 
can  without  difficulty  extend  Theorems  1-5  to  cover  the  range  -  Vi  <  d  <  0.  Indeed  the 
results  stated  in  Theorems  2-5  for  the  case  '/i<  a  <  1  apply  also  the  the  case  a  >  1, 
or  d  <  0  in  (30),  since  the  relevant  conditions  of  Hannan  and  Heyde  (1972)  and  Hannan 
(1976)  still  apply  when  a  >  1.  The  equivalent  of  Theorem  1  for  the  case  -  Vi  <  d  <  V2  in 
(30)  is  given  below. 

Theorem  7 

Let  { yfc }  be  a  stationary  ARIHA ( p , d , q )  process  (30)  with  Vi  <  d  <  Vi  •  Define 
fu(0)  as  in  (32)  above. 

(i)  If  -  V2  <  d  <  Vi  ,  then  n^2  d(y  -  V )  ~>  N(0,u2)  as  n  ♦  »,  where 

2  o2fu(0)r(1-2d) 

“  ”  (1+2d)r(1+d)f(1-d)  * 

(ii)  If  d  «  -  Vi  ,  then  n(log  n)  1//2(y  -  u)  N(0,52),  where  62  =  2x  1o2fu<0). 

Proof,  (i)  For  d  «  0  this  is  a  standard  result  (Anderson,  1971,  Theorem  7.7.8).  The 
results  for  0  <  d  <  Vi  and  -  Vi  <  d  <  0  follow  respectively  from  Theorem  1  and  the  Remark 
thereto. 

(ii)  Now  let  d  ■  V2  and  suppose  first  that  p  “  q  =  0.  Then  {yfc}  has  variance 

-  4x-1  and  correlation  function  p^  »  -1/<4k2  -  1)  (Hosking,  1981).  We  write  (5)  as 

2  n-1  k 

var  y  -  n"  yQ  J  I  Pfc  • 
k»0  j— k 


By  induction  we  can  show  that 


k 

l  p,  -  1/(2k  +  1)  , 


whence  it  follows  that  var  y  ~  n  2yQ  V2  log  n  as  n  +  ®.  It  is  now  straightforward  to 

verify  that  {yfc}  satisfies  the  conditions  of  Theorem  18. 6. 5  of  Ibragimov  and  Linnik 

(1971)  and  thence  that  Theorem  7 ( i i )  is  valid  for  an  ARIMAt 0 V2  >  0)  process. 

-1/2 

When  p  and  q  are  not  both  zero  we  define  the  process  {xfc}  by  V  x  *  at'  80 

that  yt  -  W  “  4(B)}  10(B)xt.  Now  {xt)  is  an  ARIMA(  0 ,-  V2  ,0 )  process  and,  as  we  have 

--1  -1/2 -  w  -12 

just  proved,  its  mean  x  =  n  (x1  +  ...  +  x^)  satisfies  n(log  x)  n  — >  N(0,2n  a  ) 

as  n  ■*  ms  while  the  linear  filter  {$(B)}  ^  0  ( B )  which  transforms  xt  into  yt  -  U  has 

a  continuous  spectrum  which  takes  the  value  fu(0)  at  frequency  zero.  Applying  Theorem 

-1/2-  w  -12 

18.6.4  of  Ibragimov  and  Linnik  (1971)  we  obtain  n(log  n)  (y  -  w)  — ->  N(0,2it  0  f  ( 0 ) ) , 

the  required  result. 


The  asymptotic  distributions  of  sample  autocovariances  and  autocorrelations  of 
ARIMA(p,d,q)  processes  follow  directly  from  Theorems  2-5.  The  cases  0  <  a  <  V2  ,  a  “  V2 
and  V2  <  a  <  1  correspond  to  V4  <  <3  <  V2  ,  d  «  V4  and  0  <  d  <  %  respectively. 

When  -  V2  <  d  <  0  the  asymptotic  distributions  are  Normal  with  mean  zero  and  covariances 
given  by  (7c)  and  (21c),  i.e.  the  same  as  when  0  <  d  <  V4  •  The  quantities  a,  A  and 
X/Yq  occurring  in  the  expressions  for  asymptotic  variances  are,  from  (31)  and  Hosking 
(1981), 


a 


a2f u( 0 >r ( 1  -  2d) 

fTd )  r  ( 1  -  d)  '  x/To 


f  (0) 

u 


r  ( 1  -  d) 
rtd) 


The  expressions  (7c)  and  (21c)  can  also  be  simplified  for  certain  processes,  as  we  now 
show. 

Lemma  3 

Let  {yt}  be  the  ARIMA(0,d,q)  process  ^(y^  -  U)  “  0(B)a^  with  d  <  V4  and 
4  4 

Eat  *  o  (3  +  k)  <  ” .  Then  as  n  ♦  » 

cov(ck'ct)  ~  n’1a“(Yk-4  +  Yk+*>  +  KVi  (33) 

and 

cov(rk'ri)  ~  n"1,Y0/T0)2(^-i  +  pk+i  +  4pkpt  "  2pkpt  ‘  2p£V  '  (34) 
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where  Yj  and  pj  are  respectively  the  lag-k  autocovariance  and  lag-k  autocorrelation  of 

2d  2 

the  ARIMA(0,2d,q)  process  V  (y^  -  p)  =  0(B)k>t  with  white-noise  variance  Ek>t  =  1,  and 


are  given  by 


Y*  =  !  f  ^Vkti-j  '  Pk  =  Yk/Y0  ' 


i— q  :=-q 


+  _  r  ( 1  -4d  )T (  k-f  2d) 

Yk  T  ( 2d  > T  ( 1  -2d  )T ( k+1  -2dll 


'  Yk  -  l  Vi 


are  the  lag-k  autocovariances  of  the  ARIMA( 0,2d,0 )  process  v  y  =  bfc  and  the  MA(q) 
process  yt  =  0(B)bt  respectively. 

Proof .  Let  y£  be  the  lag-k  autocovariance  of  an  ARIMA(0,d,0)  process  with  white-noise 
variance  1.  We  have  (Hosking,  1981) 


x  =  rn-2d)r(k-td) 

Yk  ridim-dirik+i-d)  ' 


y  yV  -  ( — ) 

L  „  ss+k  lr{d)r(i-d)J  L 


r<i-2d)  [2  v  rts-tdirts+k-td) 


r(3+1-d)r(s+k+1-d) 


r(i-2d)r(k-td)r(i-k-d)r(i-4d)  + 

r(d)r(i-d)r<k+i-2d)r(i-k-2d)  =  Yk  ' 


where  we  have  used  Dougall’s  formula  (Slater,  1966,  p.  180)  and  some  manipulations 

involving  the  reflection  formula  for  gamma  functions,  r(z)r(1-z)  =  t/sin  nz.  When 
2  x 

q  =  0  we  have  Y^  =  o  Yk  and  substitution  of  (35)  in  (7c)  and  (21c)  yields  (33)  and 
( 34 ) .  when  q  *  0  we  note  that 


Yk  =  ° 


2  3  u 

1  Y ,  Y 


and  a  similar  substitution  again  yields  the  results  (33)  and  (34). 
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7.  EXTENSIONS 


He  consider  three  possible  directions  in  which  the  results  of  Theorems  1-5  may  be 
extended.  Writing  yt  ■  u  +  £^jat_j  as  in  (2),  we  may  attempt  to  weaken  our  assumptions 
on:  (i)  the  asymptotic  form  of  1)/^  for  large  j >  (ii)  the  distribution  of  the  ati 
(iii)  the  dependence  structure  of  the  at* 

As  Rosenblatt  (1979)  remarks  in  a  similar  context.  Theorems  1,  3(1)  and  5(1)  can  be 
generalised,  without  any  essential  change  in  the  proof,  to  the  case  in  which  Y^  ~  k"“L(k) 
where  L  is  a  slowly  varying  function  and  the  normalization  naL(n)  replaces  na. 

Theorems  3 ( ill)  and  5(iii)  remain  true  when  Y^  ~  k”aL(k),  and  with  the  same  n1^2 
normalization.  A  possibility  for  further  research  is  to  consider  the  extension  of  Theorems 
3  and  5  to  seasonal  long-memory  processes  such  as  the  seasonal  ARIMA(0,d,0)  process 
(1  -  Bs)dyt  -  at  where  s  is  an  integer  and  0  <  d  <  V2  » 

The  assumption  of  Normality  of  {at}  in  Theorems  3  and  5  for  0  <  a  <  V2  seems 
unnecessarily  strict.  If  {yfc}  satisfies  (2)  and  (3)  with  Eafc  <  “  it  does  not  seem 
difficult  to  show  that,  in  the  notation  of  Theorem  3,  ec£  ♦  k  «■  n  ♦  •  for 
r  -  1,...,m.  This  would  imply  that  condition  (4d)  could  be  weakened  to  (4c)  without 
affecting  the  validity  of  Theorems  3  and  5.  However,  since  the  asymptotic  distributions 
of  ck  and  r^  when  0  <  a  <  V<j  do  not  involve  any  higher  moments  of  at  than  the 
variance,  one  might  expect  that  these  limiting  distributions  could  be  obtained  under  no 
stronger  an  assumption  on  the  distribution  of  at  than  (4a). 

The  assumption  that  the  at  in  (2)  are  independent  can  be  relaxed  in  certain 
circumstances,  notably  in  Theorems  2-5  when  V2  <  a  <  1  (Hannan  and  Heyde  1972,  Hannan 
1976).  Similar  extensions  may  be  entertained  for  our  other  results  and  their 
generalizations  suggested  in  this  section. 


APPENDIX.  PROOF  OF  THEOREM  16.6.5  OF  IBRAGIMOV  AND  LINNIK  (1971) 


Theorem  18.6.5  of  Ibragimov  and  Linnik  (1971,  p.  359)  is  as  follows.  Let  {x^}  be  a 

2 

sequence  of  independent,  identically  distributed  randosi  variables  with  EXq  “  0,  EX^  <  **, 


and  let 


ri  •  i  C«-A 


JL  < '  ‘ 


If  o2  -  E(Y  +  ...  +  Y  )2  ♦  •  as  n  ♦  ■, 
n  1  n 


pr{(Y1  +  ...  ♦  Yn*/°n  <  *  <2l,>  1/<2  /  ®xp(“  'J  <i2)du 


The  first  stage  of  Ibragimov  and  Linnik 's  proof  is  to  let  c]t,n  “  ck-1  ♦  •  •  •  ♦  c)t-n 


2  Y  2 

°n  “  J  ‘Tc.n  ' 

k— • 

and  show  that  c.  /o  tends  to  sero  uniformly  in  k  as  n  ♦  •».  It  is  this  part  of  the 
K|i\  n 

proof  which  is  in  error:  equations  ( 18.6. 14 )-( 18.6. 16)  are  all  incorrect.  A  correct  proof 
runs  as  follows. 

We  have  cj>n  -  c.,.,^  -  c.,.,  -  so 

c2  ■  (c  -  c  )2  +  2<c  ,  -  c.  ,)c.  .  +  c2  .  ( A.  1 ) 

j,n  j-1  j-n-1  j-1  j-n-1  j-1,n  j-1,n 

Applying  (A.1)  k  times  we  have 


),n  “  i^0  <C j-i-1  ~  C j-i-n-1 '  +  2  J^0  <Cj-i-1  '  C j-i-n-1 ,C j-i-1 ,n  +  Cj-k,n 


<  iL  (Ci  "  Ci-")2  +  2  JL  l<Ci  "  + 


in  which  an  ♦  0  as  n  ♦  •.  Equations  (A.1),  (A. 2)  and  (A. 3)  are  the  corrected  versions 
of  Ibragimov  and  Llnnik's  (18.6.15),  (18.6.16)  and  (18.6.14). 

Now  defining  akj„  -  ckn/<Jn  (not  «k/n  -  ckn  as  stated  by  Ibragimov  and  Unnik), 
the  remainder  of  Ibragimov  and  tinnik's  proof  may  be  followed  to  obtain  the  final  result. 
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